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Data-Linked  Pilot  Reply  Time  on  Controller  Workload  and 
Communication  in  a  Simulated  Terminal  Option 

“Men  have  become  the  tools  of  their  tools.  ” 

— Henry  David  Thoreau  (1817-1862) 


INTRODUCTION 

The  Aeronautical  Data  Link  System  (ADLS)  is 
being  developed  as  part  of  the  Federal  Aviation 
Administration’s  (FAA,  1995,  1997)  modernization 
plan  to  improve  safety,  reduce  delays,  and  increase 
the  efficiency  of  human  and  system  resource  utiliza¬ 
tion.  As  part  of  this  effort,  Controller/Pilot  Data 
Link  Communication  (CPDLC)  is  being  developed 
to  re-direct  routine  air  traffic  services  provided  by  an 
overly  taxed  voice  radio  communications  system. 
CPDLC  represents  the  first  phase  of  the  transition 
from  the  analog  voice  system  to  an  International 
Civil  Aviation  Organization  (ICAO)  compliant  sys¬ 
tem1.  Initially,  CPDLC  en  route  applications  will 
support  limited  services.  However,  as  CPDLC  ma¬ 
tures,  additional  services  will  be  added  and  it  may 
expand  to  include  terminal  applications.  Ultimately, 
CPDLC  services  will  provide  controllers  with  the 
capability  to  initiate  a  data  link  uplink  message,  using 
pre-defined  message  sets,  to  service  eligible  aircraft 
and  receive  data  link  messages  (FAA,  1998a,  1998b). 

Timing  Parameters:  Technology 

The  arrival  of  CPDLC  messages  to  the  intended 
receiver  is  dependent,  in  part,  upon  the  speed  of  end- 
to-end  information  transfer  among  ADLS  compo¬ 
nents.  End-to-end  transfer  delay  is  defined  as  “the 
period  elapsed  from  the  time  at  which  the  originating 
user  initiates  the  triggering  event  until  the  time  the 


transmitted  information  is  available  for  display  to  the 
intended  recipient”  (FAA,  1 997,  p.  39) .  Based  on  this 
definition,  the  estimated  end-to-end  transfer  delay 
times  and  performance  limits,  as  derived  from  the 
initial  requirements  for  CPDLC  in  the  terminal  do¬ 
main,  are  presented  in  Table  1  (FAA,  1997). 

A  few  studies  of  data  link  flight  deck  simulation 
have  reported  throughput  delays  (this  could  include 
the  processing  speed  of  a  device  in  Mhz,  the  data 
transfer  rate,  and  other  delays  due  to  the  limitations 
of  the  technology).  For  instance,  Waller  and  Lohr 
(1989)  incorporated  a  4.  Is  end-to-end  transfer  delay, 
and  Knox  and  Scanlon  (1991)  included  a  1.5s  delay 
(3s  round-trip  delay).  Likewise,  delays  of4-6s  (mean 
=  5s)  have  been  used  by  the  Data  Link  Benefits  Study 
Team  (DLBST)  to  examine  terminal  data  link  (1996) 
and  delays  of  6s  multiples  on  downlink  for  an  en 
route  Mode  S  radar  system  (1995). 

Timing  Parameters:  Human  Performance 

Total  transaction  times  will  inevitably  involve 
human  delays.  Airborne  systems,  for  example,  in¬ 
clude  a  2s  delay  before  a  pilot  could  reply  to  an  ATC 
transmission  (SAE  ARP4791  Revision  A,  7.7.11). 
This  parameter  allows  the  non-flying  pilot  sufficient 
time  to  read  10  words  from  a  display  with  an  average 
silent  reading  rate  of  about  5  words  per  s  (Stricht  & 
Hall,  1984).  Therefore,  under  optimal  conditions,  a 
pilot  flying  in  terminal  approach  control  airspace 
could  receive  a  message  5s  after  it  was  sent,  read  a  1 0- 


TABLE  1.  CPDLC  End-to-End  Transfer  Delay  Performance  Presented  by  Domains. 


Domain 

Mean  End-to-End 

95%  End-to-End 

99.996%  End-to-End 

Transfer  Delay 

Transfer  Delay 

Transfer  Delay 

Terminal 

5  sec 

8  sec 

12.5  sec 

En  Route 

10  sec 

15  sec 

22  sec 

1  The  system  shall  comply  with  ICAO  Standards  and  Recommended  Practices  (SARPs),  Aeronautical  Telecommunications, 
Annex  10  to  the  Convention  on  International  Civil  Aviation,  Volume  III,  Part  I,  Digital  Communication  Systems ,  Chapter  3, 
Aeronautical  Telecommunication  Network  (ATN). 
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word  message  in  2s  and  be  ready  to  transmit  a  reply. 
From  the  moment  the  message  leaves  the  ground 
until  the  pilot  executes  a  response,  7s  lapses. 

On  the  airborne  side,  total  transaction  time  has 
been  defined  as  “message  receipt  to  pilot  acknow¬ 
ledgement  in  data  link”  (Logsdon,  et  ah,  1995,  p. 
327).  It  includes  time  for  the  pilot  to  access  the 
message,  read  it,  and  acknowledge  it  (McGann,  et  al., 
1998).  However,  in  some  instances,  “total  transac¬ 
tion  time”  and  “response  time”  appear  to  be  inter¬ 
changeable.  Waller  and  Lohr  (1989),  for  example, 
defined  response  time  as  “the  time  between  the  first 
alerting  signal  indicating  the  arrival  of  a  new  message 
in  the  cockpit  and  the  copilot  depressing  the  ‘ENT’ 
key  to  downlink  a  roger  or  unable  response”  (p.  8) .  In 
contrast,  Talotta  et  al  (1990)  decomposed  total  trans¬ 
action  time  into  Response  Latency  (RL)  and  Wilco/ 
UNABLE  Response  Time  (WUT).  RL  was  defined  as 
“the  interval  begins  when  ‘Touch  for  ATC  Message’ 
appears  on  the  display  and  ends  when  the  pilot 
touches  the  prompt  ‘Touch  for  ATC  Message1.”  The 
WUT  was  defined  as  “The  interval  begins  with  the 
appearance  of  the  ATC  Instruction  on  the  display 
screen  and  ends  with  the  touch  of  WILCO  or  UN¬ 
ABLE”  (p.  35). 

On  the  ground  side,  the  results  of  the  1996  Data 
Link  Benefits  Study  Team  (DLBST)  study,  performed 
at  the  FAA’s  William  J.  Hughes  Technical  Center  for 
terminal  approach  control  data  link,  revealed  con¬ 
troller  transaction  times  that  ranged  from  8s  to  more 
than  200s.  In  that  study,  total  transaction  time  was 
defined  as  “the  period  of  elapsed  time  from  the 
controller’s  input  to  send  the  message  to  the  appear¬ 
ance  of  a  downlinked  response  on  the  controller’s 
display”  (p.79).  Furthermore,  it  “includes  the  techni¬ 
cal  system  delays  associated  with  uplink  and  down¬ 
link  and  the  time  required  by  the  pilots  to  detect, 
process,  and  respond  to  the  message”  (p.  77) .  A  closer 
examination  of  the  frequency  distribution  of  end-to- 
end  transfer  delay  times  revealed  that  about  74%  of 
the  transactions  were  completed  between  10.1s  and 
16. Os.  It  was  further  noted  that  completing  transac¬ 
tions  in  less  than  10s  occurred  for  fewer  than  250  of 
the  9,036  messages. 

In  a  simulation  study  performed  by  Knox  and 
Scanlon  (1991)  “total  message  transaction  time”  was 
defined  as  “the  time  from  when  a  message  is  sent  from 
the  ground  until  the  ground  receives  the  pilot’s  roger 
or  unable  response”  (p.  9).  This  definition  is  compa¬ 
rable  to  the  one  provided  in  the  DLBST  Report 


(1996).  That  is,  total  transaction  time  represents  the 
entire  time  span  a  controller  would  need  to  maintain 
awareness  of  the  status  of  a  communication. 

Clearly,  technology-  and  human-based  delays  can 
influence  the  efficacy  of  air-ground  operational  com¬ 
munication  performance  required  for  ATS  commu¬ 
nications  supporting  specific  services,  operations,  or 
procedures  within  defined  homogeneous  airspace. 
For  example,  the  Kerns  (1991)  review  of  the  data  link 
literature  indicated  that,  on  the  average,  data  link 
total  transaction  times  were  twice  as  long  as  for  voice. 
Likewise,  en  route  total  transaction  times  varied  from 
19-21  seconds  for  data  link  and  8-10  seconds  for 
voice  (Waller  &  Lohr,  1989;  Talotta  et  al.,  1990). 
These  added  delays  resulted,  in  part,  from  pilots 
auto-loading  information  into  their  navigation  com¬ 
puter  Control  Display  Unit  (CDU)  before  down 
linking  an  acknowledgment  (Waller  &:  Lohr,  1989). 

Workload 

Kerns'  (1991)  review  of  the  data  link  literature 
states,  “Virtually  all  of  the  studies  report  no  signifi¬ 
cant  effect  on  pilot  or  controller  workload  as  a  result 
of  using  the  data  link”  (ppl91).  In  a  later  statement, 
Kerns  indicates  that,  with  respect  to  pilots,  "...  the 
research  results  do  document  a  redistribution  of 
workload  across  the  human’s  information-process¬ 
ing  resources:  Visual  and  manual  workload  increase 
whereas  auditory  and  speech  workload  decrease 
(Grouce  &  Boucek,  1987).  Likewise,  for  controllers, 
Talotta  et  al.  (1990)  reported  a  reduced  speech 
workload  and  an  increased  manual  workload  when 
data  link  was  used. 

These  outcomes  suggest  that  the  redistribution  of 
workload  across  input  and  response  domains  was 
insufficient  to  influence  overall  workload.  To  ad¬ 
dress  this  peculiarity,  Prinzo  (1998)  conducted  a 
simulation  study.  Following  the  completion  of  heavy 
and  light  traffic  simulations  using  voice  radio  only  or 
a  combination  of  voice  radio  and  a  data  link,  control¬ 
lers  provided  subjective  ratings  of  workload,  using 
the  NASA  Task  Load  Index  (TLX)  (Hart  &  Staveland, 
1988).  An  analysis  was  performed  on  the  controllers’ 
subjective  ratings  along  6-dimensions  of  workload 
and  on  a  separate  overall  rating.  In  addition  to  their 
ratings  revealing  a  greater  perceived  overall  workload 
among  controllers  when  providing  approach  control 
services  in  a  mixed  compared  with  a  voice  only 
environment,  their  ratings  revealed  a  perceived  in¬ 
crease  on  several  of  the  individual  dimensions. 


For  the  individual  ratings,  controllers’  ratings  were 
significantly  higher  on  the  temporal  and  frustration 
dimensions  and  approached  significance  on  physical 
demands.  It  may  be  that  the  perceived  alterations  in 
workload  resulted  from  controllers  switching  be¬ 
tween  voice  radio  and  data  link  in  a  mixed-modality 
environment,  using  a  communications  system  that 
was  slower  than  voice  radio,  or  both.  Consequently, 
their  subjective  ratings  on  the  physical  demand  di¬ 
mension  may  have  increased  as  keyboard  entries 
multiplied.  Likewise,  their  ratings  on  the  temporal 
demand  dimension  could  have  resulted  from  changes 
in  the  temporal  component  of  the  communications 
system  (i.e.,  voice  radio  is  virtually  instantaneous, 
whereas  data  link  is  not).  These  findings  agree  with 
the  perceptions  reported  by  Auckland  Oceanic  con¬ 
trollers  who  estimated  about  a  40%  increase  in 
workload  with  CPDLC,  without  a  corresponding 
increase  in  traffic  (Ruitenbuerg  1998). 

It  is  also  possible  that  an  environment  supporting 
both  voice  radio  and  data  link  unknowingly  adds  a 
modality-monitoring  task  to  the  controller’s  cogni¬ 
tive  workload.  This  may  inadvertently  increase  per¬ 
ceived  ratings  of  workload.  As  shown  in  the  upper 
portion  of  Figure  1,  in  a  unimodal  communication 
environment,  controllers  easily  monitor  their 
communication  transactions  with  pilots  and  may 


hypothetically  set  an  internal  reply  timer.  If,  after 
some  number  of  seconds,  a  reply  is  not  received,  the 
controller  might  verbally  ask  the  pilot  if  the  message 
was  received.  The  lower  portion  shows  that,  in  a  dual¬ 
mode  environment,  controllers  might  set  one  im¬ 
plicit  internal  timer  for  voice  radio  (faster)  and  another 
for  data  link  (slower)  and  develop  a  strategy  to  moni¬ 
tor  the  status  of  each. 

In  a  dual-mode  environment,  controllers  could 
create  one  internal  timer  based  on  a  single  mode,  but 
it  could  create  problems.  For  example,  using  voice 
radio  as  the  default  could  add  to  controller  workload 
by  increasing  the  number  of  queried  data  link  trans¬ 
missions  (not  letting  the  data  link  total  transaction 
time  lapse  before  re-sending  the  message) .  Using  data 
link  as  the  default  could  create  delays  or  untimely 
events  for  aircraft  equipped  for  voice  only  communi¬ 
cations.  Consequently,  inclusion  of  a  second  com¬ 
munications  system  into  air  traffic  control  operational 
communications  could  alter  communication  perfor¬ 
mance  and  perceived  workload. 

Just  as  the  controllers  who  participated  in  the 
Prinzo  study  (1998)  reported  elevated  subjective 
workload,  so  did  the  assistant  controllers  who  partici¬ 
pated  in  DLBST  Experiment  3(1 996) .  In  that  DLBST 
experiment,  the  assistant  controllers  sent  data  link 
messages  to  the  aircraft,  as  did  the  controllers  in  the 
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Figure  1.  Hypothetical  cognitive  workload  for  voice  and  data  link  messages. 
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Prinzo  study.  In  both  simulation  studies,  controllers 
provided  air  traffic  services  during  complex  traffic 
situations  (a  mix  of  aircraft  arriving  at  the  major  and 
satellite  airports).  The  DLBST  concluded  that  pro¬ 
viding  air  traffic  services  during  highly  variable  traf¬ 
fic  situations  (e.g.,  many  different  airport  destinations, 
an  assortment  of  aircraft  types  and  performance  char¬ 
acteristics,  multiple  arrival/departure  routes)  can  pro¬ 
duce  perceptions  of  greater  workload  when  working 
with  a  new  set  of  communications  procedures/tools. 
It  was  unclear  whether  the  changes  in  workload  and 
communication  performance  were  attributable  to  the 
inherent  temporal  delays  associated  with  data  link 
transmissions,  providing  air  traffic  services  in  a  dual 
mode  environment,  or  both. 

Bower  and  Clapper  (1989)  pointed  out  that  people 
generally  tend  to  pause  longer  while  speaking,  espe¬ 
cially  when  heavily  involved  in  planning  the  next 
portion  of  their  utterance  (pp  281).  This  observation 
also  was  noted  by  Prinzo,  Lieberman,  and  Pickett 
(1998)  in  one  simulation  study  where  82%  of  the 
controllers  produced  longer  intra-sentential  pauses 
for  light  rather  than  heavy  traffic  simulations.  Prinzo 
et  ah  (1998)  suggested  that  pause  duration  could 
reflect  differences  in  information  processing  demands 
among  controllers.  That  is,  during  a  lighter  workload 
situation,  controllers  seemed  to  use  a  more  flexible, 
cognitive  approach  towards  traffic  management.  In 
effect,  the  lack  of  a  traffic  demand  provided  them 
with  more  time  to  strategize  and  vector  aircraft. 
Then,  as  traffic  increased,  they  seemed  to  switch  to  a 
more  automatic  and  repetitive  approach  towards 
maneuvering  traffic  through  their  airspace.  Thus, 
hesitation  pauses  in  the  context  of  air  traffic  control 
might  reflect  cognitive  demands  related  to  workload. 
That  is,  reductions  in  workload  could  be  reflected  by 
the  presence  of  longer  intra-sentential  pauses,  indica¬ 
tive  of  more  deliberate  thought. 

The  purpose  of  this  simulation  study  was  to  disen¬ 
tangle  the  effects  of  delay  from  those  due  to  the 
communication  environment  on  controller  workload. 
To  accomplish  this,  temporal  variations  (all  immedi¬ 
ate  responses  or  mixed)  and  ghost  pilot  response  type 
(voice  immediate,  data  link  immediate  or  delayed  by 
approximately  11s)  were  manipulated.  Their  inde¬ 
pendent  and  combined  effect  on  controller  workload, 
communication  performance,  and  the  performance 
of  initial  contact  and  transfer  of  control  subtasks 
were  examined. 


METHOD 

Participants 

Eight  full-performance  level  air  traffic  control 
specialists  from  a  level  5  TRACON  facility  partici¬ 
pated  in  the  study.  Collectively,  they  had  14. 1 9  mean 
years  of  terminal  experience  (SD  =  5.9),  with  9.1 
mean  years  (SD  =7.0)  at  the  full-performance  level. 

Apparatus 

The  CAMI  TRACON  PC-based  simulation  labo¬ 
ratory  includes  2  file  servers,  2  controller  worksta¬ 
tions,  2  ghost  pilot  workstations,  and  1  remote 
position  workstation.  Airspace  and  radar  data  were 
presented  on  21 -inch  monitors.  The  laboratory  is 
designed  to  provide  full  audio  and  video  recording 
capability.  A  detailed  description  can  be  found  in 
Prinzo  (1998). 

Simulation  Support  Staff 

The  simulation  support  staff  consisted  of  2  ghost 
pilots,  2  retired  controllers  serving  as  subject  matter 
experts  (SMEs),  and  a  software  technician.  The  cer¬ 
tified  ghost  pilots,  formally  trained  and  instructed  in 
ATC  communications  by  a  vendor  at  the  FAA  Acad¬ 
emy  in  Oklahoma  City,  also  provide  support  services 
at  the  Academy.  One  SME  reviewed  and  modified 
the  scenarios,  developed  briefing  materials,  trained 
the  ghost  pilots  on  the  TRACON  system  and  sce¬ 
narios,  and  provided  them  with  on-line  instruction 
during  each  simulation.  The  other  SME  was  the 
receiving  controller  during  simulations.  The  soft¬ 
ware  technician  developed  front-end  applications  for 
the  TRACON  software  to  reduce  the  amount  of  time 
and  level  of  effort  required  for  database  construction 
and  scenario  development. 

Materials 

Scenario  Development.  The  TRACON  facility’s 
“1997  Game  Plan,”  an  internal  document,  was  used 
to  select  the  time  intervals  for  simulation.  It  provides 
historical  information  pertaining  to  arrival  rushes  by 
direction  of  arrival  into  the  TRACON  airspace.  The 
TRACON  facility  also  provided  computer  data  that 
contained  actual  flight  plans  for  a  24-hour  (hr)  time 
interval.  The  flight  plan  data  were  reformatted  and  one 
35-minute  (min)  time  interval  was  selected  for  simula¬ 
tion.  The  flight  plan  data  also  were  used  to  develop  one 
15-min  practice  scenario  to  instruct  and  train  partici¬ 
pants  on  the  use  of  the  TRACON  simulator. 
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TABLE  2.  Distribution  of  Arrivals  Presented  by  Aircraft  Type  and  Time  Interval  in  the 
Scenario 


Time  Interval 

Arrival  Aircraft 

(in  Minutes)  ~ 

Props 

AAL  (MD80) 

Other  Jets 

Total 

00-09 

0 

6 

6 

12 

10-19 

2 

7 

2 

11 

20-29 

0 

6 

3 

9 

30-40 

0 

3 

2 

5 

Total 

2 

22 

13 

37 

As  shown  in  Table  2,  the  distribution  of  aircraft 
approaching  the  sector  during  each  10-min  time 
interval  was  moderate.  Table  2  also  shows  that  ap¬ 
proximately  60%  of  the  arrival  aircraft  were  from 
American  Airlines5  (AAL)  fleet  of  MD80s,  and  all  of 
them  were  data  link  equipped. 

The  following  constraint  was  imposed.  Although 
all  of  the  airplanes  in  each  of  the  scenarios  were  voice 
radio  equipped,  onlyAAL’s  MD80  aircraft  were  data 
link  equipped.  The  Feeder  East  arrival  aircraft  ap¬ 
peared  approximately  5  miles  (mi)  from  the  North¬ 
east  and  Southeast  vortac.  All  arrival  aircraft  were  on 
a  north  flow.  The  last  arrival  appeared  approximately 
35min  into  the  simulation.  The  simulation  was 
stopped  once  the  last  MD80  aircraft  was  handed-off 
to,  and  accepted  by,  the  receiving  controller  staffing 
the  Final  sector.  The  fidelity  and  realism  of  the 
scenario  were  evaluated  by  staff  from  the  TRACON 
facility  to  ensure  that  it  was  representative  of  day  to 
day  traffic  operations  for  the  position. 

NASA  Task  Load  Index.  Hart  and  Staveland  (1988) 
developed  the  NASA  Task  Load  Index  (TLX).  It  is  a 
widely  used  and  accepted  multi-dimensional  subjec¬ 
tive  rating  procedure  and  is  an  index  of  perceived 
workload.  They  conceptualized  workload  as  a  con¬ 
struct  that  involves  6  dimensions:  Mental  Demands, 
Physical  Demands,  Temporal  Demands,  Performance, 
Effort,  and  Frustration.  Five  of  the  scales  are  an¬ 
chored  with  “low”  (0)  on  the  left  and  “high”  (100)  on 
the  right.  The  Performance  scale  is  anchored  by 
“good”  ( 1 00)  on  the  left  of  the  dimension  and  “poor” 
(0)  on  the  right. 


Simulated  Prototypical  Data  Link  Services 

Only  the  control  instructions  (Cl),  terminal  infor¬ 
mation  (TI),  and  transfer  of  communication  (TOC) 
data  link  services  were  simulated.  The  instructions 
on  how  these  services  were  executed  are  presented 
below.  The  initial  contact  (IC)  service  was  not  exam¬ 
ined  in  this  study.  Instead,  current  voice  radio  proce¬ 
dures  for  establishing  radar  contact  were  implemented. 
The  full  data  block  would  appear  flashing  on  the 
receiving  controller’s  terminal  display  and  an  asterisk 
(*)  would  precede  the  call  sign  of  a  data-link-equipped 
aircraft.  The  data  link  was  active  and  available  for  the 
controller  to  uplink  the  first  message.  When  the 
controller  accepted  the  handoff,  the  ghost  pilot  would 
state  the  aircraft  call  sign,  altitude,  and  current  Auto¬ 
matic  Terminal  Information  Service  (ATIS)  code 
(e.g.,  “American  one  twenty-three  with  you  at  one 
two  thousand  with  information  Alpha”). 

Cl  and  TI  Messages.  Controllers  could  select  any  of 
the  Cl  and  TI  topics  from  the  menu  list  presented  in 
Figure  2.  The  controller  depressed  [FI 6]  and  the 
alphanumeric  key  associated  with  that  entry  (i.e.,  1, 
2,  3,  A,  B,  etc.),  slewed  the  trackball  until  the  cursor 
“E”  was  overlaid  upon  the  position  symbol  “E”  asso¬ 
ciated  with  the  desired  aircraft,  and  then  depressed 
the  Enter  key.  During  message  construction,  the 
alphanumeric  keys  that  were  depressed  were  echoed 
back  in  the  preview  area  of  the  controller’s  terminal 
display  (e.g.,  FI 6  1).  After  the  Enter  key  on  the 
trackball  was  depressed,  the  information  in  the  pre¬ 
view  area  was  erased  and  replaced  by  the  aircraft  call 
sign,  message  topic,  and  the  status  “SND”  in  the 
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Data  Link  Uplink  Message  List 

Uplink  Message  in  the  Full  Data  Block 

CI 

TI 

1.  A050 

A  EXP  RWY31R 

/  *AAL123 

2.  A060 

B  EXP  RWY35R 

/  110  250 

3.  S210 

/  A050 

4.  S230 

E  / 

5.  H290 

6.  H280A060 

Figure  2.  Cl  and  Tl  Uplink  Messages. 


status  list  (e.g.,  AAL123  A050  SND).  The  Cl  message 
also  appeared  in  the  third  line  of  the  full  data  block 
with  the  numeric  data  and  an  appropriate  preceding 
letter  of  A,  H,  or  S  (e.g.,  A050). 

As  soon  as  the  controller  sent  the  uplinked  message, 
it  appeared  on  the  ghost  pilot’s  display  in  the  third  line 
of  the  full  data  block  for  the  receiving  aircraft  (e.g., 
AO 50).  The  ghost  pilot  selected  “WILCO”  to  ac¬ 
knowledge  receipt  of  the  uplinked  message  and,  either 
immediately  or  after  approximately  11s,  sent  the  down¬ 
link  to  the  controller.  For  the  controller’s  terminal 
display,  “WILCO”  remained  in  the  third  line  of  the 
full  data  block  until  the  controller  closed  the  transac¬ 
tion.  The  controller  overlaid  the  cursor  and  datatag 
position  symbols  and  then  depressed  the  Enter  key  on 
the  trackball.  This  procedure  deviated  from  the  origi¬ 
nal  design  presented  in  a  MITRE  document  ( 1 990) .  In 
that  document,  the  “WILCO”  disappeared  from  the 
controller’s  display  after  a  predetermined  timeout  pa¬ 
rameter.  No  action  on  the  part  of  the  controller  was 
required.  We  chose  to  change  this  procedure  because 
the  controller  could  be  scanning  a  different  area  of  the 
controller’s  terminal  display  and  miss  the  downlink 
acknowledgment. 

Manual  Mode  TOC.  The  sending  controller  con¬ 
structed  and  transmitted  the  TOC  by  depressing  the 
[F9]  key  which  resulted  in  the  appearance  of  the  “TC” 
in  the  preview  area  of  the  controller’s  terminal  display. 
The  controller  then  slewed  the  trackball  until  the 
sending  and  receiving  controller’s  position  symbols 
were  overlaid  upon  one  another  in  the  data  block. 
When  the  Enter  key  on  the  trackball  was  depressed,  the 
“TC”  disappeared  and  no  further  action  was  required. 
The  ghost  pilot  did  not  “WILCO”  the  TOC,  and  there 
was  no  change  to  the  status  list.  When  the  receiving 


controller  accepted  responsibility  for  an  aircraft,  the 
sending  controller’s  display  was  replaced  with  a 
radar  secondary  track,  and  the  sending  controller’s 
position  symbol  was  replaced  by  the  receiving 
controller’s  position  symbol. 

The  current  CPDLC  TOC  design  specification 
requires  a  “WILCO”  acknowledgment  from  the 
pilot  for  a  TOC.  It  includes  the  display  of  a  message 
sent  in  the  data  block.  It  also  includes  a  change  in  the 
sending  controller’s  display  from  a  “data  link  eligi¬ 
bility  (*)”  to  an  “active  session  (+)”  indicator  mean¬ 
ing  that  the  aircraft  is  capable  of  data  link 
communication  but  the  sending  sector  is  no  longer 
eligible  to  send  a  message.  This  feature  was  not 
included  as  part  of  the  transfer  of  communication  in 
the  current  study  since  the  sending  controller  could 
not  communicate  with  the  aircraft  by  data  link  once 
radar  transfer  was  accepted  and  the  TOC  was  trans¬ 
mitted. 

Although  the  data  link  services  reported  here 
deviated  from  the  current  designs  being  evaluated 
by  FAA  for  data  link  services,  the  fundamental 
concept  is  not  unique  to  this  simulation  study.  That 
is,  data  link  services  will  be  provided  by  a  commu¬ 
nications  system,  that  uses  digitized  signals,  as  was 
done  here.  Likewise,  input  into  that  communica¬ 
tions  system  will  be  performed  by  controllers  who 
will  make  entries  using  a  keyboard-input  module 
and  trackball,  as  was  done  here. 

Procedure 

After  the  required  administrative  paperwork  was 
completed,  each  controller  received  4hrs  of 
familiarization  training  on  the  simulator.  They  also 
were  instructed  on  the  procedures  for  transfer  of 
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communications  (TOC),  constructing  controller  in¬ 
structions  (Cl)  and  terminal  information  (TI),  and 
transmitting  messages  using  the  ARTS  IIIA  data  link 
interface.  During  that  time,  the  trainer  observed  the 
controllers  demonstrating  their  skill  and  dexterity 
with  the  ABC-style  keyboard-input  module.  The 
controller  completed  a  15-min  practice  scenario  rep¬ 
resentative  of  arrival  traffic  on  the  sector.  Any  prob¬ 
lems  were  noted  and  corrected  through  additional 
training  or  practice. 

Following  familiarization  training,  controllers 
completed  a  practice  scenario  to  reinforce  and  in¬ 
crease  their  data  link  communication  skills.  Then 
controllers  completed  the  first  30-min  scenario,  pro¬ 
vided  TLX  workload  ratings,  and  received  a  15-min 
break,  and  so  on  until  each  of  the  scenarios  was 
completed  twice.  While  providing  air  traffic  services 
to  simulated  traffic,  controller  voice  communica¬ 
tions  were  recorded  onto  digital  analog  tapes  and 
time  stamped.  Radar  display  and  ARTS  IIIA  key¬ 
board  and  trackball  entries  were  recorded  on  VHS 
tapes.  At  the  end  of  the  study,  each  controller  com¬ 
pleted  a  questionnaire  and  provided  a  written  evalu¬ 
ation  and  comments  related  to  using  data  link  on  the 
simulated  sector. 

Experimental  Design 

All  of  the  controllers  provided  air  traffic  services  in 
a  simulation  environment  supporting  dual  modes  of 
communications.  The  temporal  characteristics  of  the 
ATC  simulation  environment  were  examined  by 
manipulating  the  delay  interval  of  the  downlinked 
responses  to  ATC  messages.  Ghost  pilots  were  in¬ 
structed  to  provide  immediate  responses  to  both  data 
link  and  voice  radio  transmissions  (immediate  condi¬ 
tion)  or  immediate  responses  to  voice  radio  and 
delayed  responses  to  data  link  (mixed  condition).  All 
non-data-link-equipped  aircraft  received  immediate 
responses  to  their  voice  radio  messages. 

Each  controller  completed  the  same  scenario  twice, 
once  with  immediate  downlink  responses  and  once 
with  downlink  responses  delayed  by  approximately 
11s.  The  order  of  presentation  was  counterbalanced. 
Type  of  aircraft  equipage  (data  link  equipped,  non¬ 
data  link  equipped) ,  mode  of  communications  (voice 
radio,  data  link)  and  ghost  pilot  response  type  (all 


immediate,  mixed)  were  the  experimental  variables 
of  interest.  Since  the  scenario  was  representative  of  an 
actual  sample  of  traffic  from  the  facility,  it  was 
congruent  with  controller  expectancies  and  should 
not  adversely  influence  workload. 

Dependent  Measures 

Subjective  Workload.  Participant  ratings,  pro¬ 
vided  on  each  dimension  of  the  NASA  Task  Load 
Index,  served  as  indices  of  perceived  workload.  Indi¬ 
vidual  and  composite  ratings  were  obtained  follow¬ 
ing  each  simulation. 

Objective  Workload.  There  were  3  measures  of 
objective  workload.  They  were  1)  aircraft  activity 
levels,  2)  total  time  on  frequency  and,  3)  hesitation 
pauses  (Eisler  1968).  They  are  enumerated  below. 

Aircraft  Activity  Levels.  Workload  was  measured 
by  the  number  of  active  aircraft  still  on  frequency 
when  the  controller  initiated  a  transmission.  An 
aircraft  was  counted  as  being  under  positive  control 
once  it  established  initial  contact  with  the  controller. 
It  was  no  longer  under  positive  control  after  the 
controller  completed  the  2-stage  hand-off  procedure: 
1)  an  automated  radar  hand-off  and  2)  transfer  of 
communication  to  the  next  controller  in  the  se¬ 
quence.  This  approach  was  used  to  maintain  conti¬ 
nuity  with  current  transfer  of  control  procedures. 

Total  Time  on  Frequency.  For  messages  transmit¬ 
ted  by  voice-radio,  the  total  time  on  frequency  was 
measured  by  placing  cursors  at  the  onset  and  offset  of 
speech,  as  determined  by  visual  examination  of  the 
waveform  and  by  listening  to  the  speech  sample.  For 
data  link  transmissions,  total  time  on  frequency  was 
measured  as  the  amount  of  time  that  lapsed  between 
the  onset  of  a  hand  movement  to  the  [FI  5]  or  [FI  6] 
key  on  the  ARTS  IIIA  keyboard  and  when  the  trackball 
[enter]  key  was  depressed.  This  was  accomplished  by 
viewing  the  time-stamped  audio-video  recordings. 

Hesitation  Pauses.  For  all  participants,  within- 
utterance  pause  duration  and  pause  frequency  were 
extracted  from  the  audio-videotapes.  Some  articula¬ 
tory  gestures  of  speech  (e.g.,  stop  consonants,  breath¬ 
ing)  necessarily  result  in  brief  periods  of  silence2.  For 
motor  production,  both  the  within-message  pause 
duration  and  pause  frequency  were  extracted  by  view¬ 
ing  the  videotapes.  Pause  duration  was  defined  as  a 


2  Breathing  is  necessary  for  fluent  speech  production.  Setting  a  pause  duration  of  25  milliseconds  (ms)  as  a  lower  bound 
eliminated  it  as  a  factor. 
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lack  of  a  hand  movement  about  the  keyboard  during 
message  construction.  Only  transmissions  contain¬ 
ing  pauses  exceeding  .25s  were  included.  Pause  fre¬ 
quency  was  computed  by  counting  the  number  of 
pauses  in  a  transmission. 

Communication  Performance.  Measures  of  com¬ 
munication  performance  were  associated  with  the 
contents  of  controller  messages  and  message  produc¬ 
tion.  Message  contents  involved  the  number  of  avia¬ 
tion  topics  in  a  message  and  non-standard 
communications.  Message  production  included  the 
adjusted  time  on  frequency  (total  time  on  frequency 
adjusted  for  hesitation  pauses)  and  message  restarts. 

Message  Production .  The  adjusted  time  on  fre¬ 
quency  and  number  of  restarts  were  computed  for 
each  utterance  and  data  link  transmission.  The  total 
time  that  a  controller  was  on  frequency  consisted  of 
three  components:  pause  duration,  message  selec¬ 
tion/construction,  and  transmission  time.  The  ad¬ 
justed  time  on  frequency  was  derived  by  subtracting 
pause  duration  from  total  time  on  frequency. 

The  number  of  restarts  was  defined  as  the  re¬ 
initiation  of  a  transmission  to  an  aircraft.  This  was 
determined  by  listening  to  voice-radio  transmissions 
and  counting  the  number  of  times  the  controller  told 
the  pilot  to  “disregard”  or  reinitiated  a  message.  For 
data  link  transmissions,  the  number  of  restarts  was 
determined  by  reviewing  the  audio-video  tapes  and 
counting  how  often  the  controller  depressed  the  clear 
key  on  the  keyboard  during  message  construction. 

Message  Contents.  By  parsing  messages  into  mes¬ 
sage  elements,  the  number  of  aviation  topics  in  voice- 
radio  and  data  link  messages  was  determined,  tallied, 
and  recorded  according  to  the  methods  and  proce¬ 
dures  outlined  by  Prinzo,  Britton,  and  Hendrix 
(1995).  The  number  of  non-standard  communica¬ 
tions  per  message  was  determined  by  comparing  the 
phraseology  spoken  to  the  required  phraseology  con¬ 
tained  in  FAA  Order  7110.65  (FAA,  2000). 

Initial  Contact  and  Transfer  of  Control  Services. 
Time  is  a  crucial  component  of  message  delivery  in 
maintaining  safety.  Temporal  factors  associated  with 
downlinked  pilot  responses  could  influence  when 
controllers  accept  or  transfer  responsibility  for  sepa¬ 
ration  assurances  between  aircraft.  An  analysis  was 
performed  on  the  controllers’  communication  and 
performance  to  provide  initial  contact  and  transfer  of 
control  services  and  data  were  extracted  from  video¬ 
taped  recordings  made  during  each  simulation.  A 
template  of  the  aircraft  arrival  routes  containing  mile 


markings  from  the  airport  was  developed  to  calculate 
the  aircraft’s  location  along  its  filed  flight  plan.  The 
process  used  to  extract  temporal  and  location  informa¬ 
tion  pertaining  to  these  services  is  enumerated  below. 

Initial  Contact  Services.  For  purposes  of  this  study, 
initial  contact  services  included  the  acceptance  of  the 
radar  track  and  first  transmission  to  a  data-link- 
eligible  aircraft.  ACCEPT  RADAR  time  was  defined 
as  the  time  lapsed  from  the  moment  the  controller 
began  to  move  the  trackball  onto  a  flashing  target  and 
ended  when  the  trackball  Enter  key  was  depressed. 
ACCEPT  RADAR  fix  was  defined  as  the  number  of 
miles  the  aircraft  was  from  the  airport  along  its  arrival 
route  when  radar  contact  occurred. 

The  INITIAL  CALL-UP  time  to  each  aircraft  was 
extracted  from  the  verbatim  transcripts.  It  was  re¬ 
corded  in  minutes  and  seconds  from  the  onset  to 
offset  of  the  controller’s  first  transmission  to  a  data- 
link-eligible  aircraft.  The  INITIAL  CALL-UP  fix 
was  defined  as  the  number  of  miles  the  aircraft  was 
from  the  airport  along  its  arrival  route  when  two-way 
communications  were  established  and  generally  oc¬ 
curred  when  the  controller  completed  the  first  trans¬ 
mission  to  the  aircraft.  Only  the  amount  of  time  that 
it  took  the  controller  to  state  the  aircraft  call  sign,  call 
sign  plus  “Roger,”  “Contact,”  or  another  acknowledg¬ 
ment  was  included  to  determine  the  initial  call-up  fix. 

Transfer  of  Control  Services.  The  INITIATE 
TRANSFER  OF  RADAR  TRACK  time  was  mea¬ 
sured  in  minutes:  seconds.  The  moment  the 
controller’s  hand  extended  to  the  keyboard-designa¬ 
tion  of  the  receiving  controller’s  position  symbol,  “J” 
or  “Z,”  to  when  the  hand  moved  to  and  depressed  the 
click-button  on  the  slew  ball  was  extracted  from 
videotape.  The  INITIATE  TRANSFER  RADAR 
TRACK  fix  was  measured  in  miles  from  aircraft  to 
airport  when  radar  transfer  was  completed. 

The  TRANSFER  OF  COMMUNICATIONS  was 
measured  in  minutes  and  seconds  from  the  onset  to 
offset  of  the  final  transmission  made  by  the  controller 
transferring  communications.  Onset  time  was  mea¬ 
sured  from  the  moment  the  sending  controller’s  hand 
moved  to  and  depressed  the  [F9]  key  on  the  key¬ 
board.  Offset  time  was  measured  from  the  moment 
the  sending  controller’s  hand  moved  to  and  then 
depressed  the  Enter  key  on  the  trackball  causing  the 
“TC”  to  disappear  from  the  PVD.  The  transfer  of 
communication  fix  was  the  number  of  miles  the 
aircraft  was  from  the  airport  when  TOC  occurred. 
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RESULTS 

The  Relationship  Between  the  Temporal  Characteris¬ 
tics  of  the  Simulation  Environment  and  Subjective 
Workload 

The  temporal  characteristics  of  the  simulated  ATC 
environment  were  examined  by  manipulating  the 
response  delays.  Ghost  pilots  were  instructed  to  pro¬ 
vide  immediate  responses  to  data-link  and  voice- 
radio  transmissions  (immediate  condition)  or  a 
combination  of  immediate  responses  to  voice  radio 
and  delayed  responses  to  data  link  (mixed  condition) . 

The  mean  and  standard  deviation  (SD)  of  the 
subjective  ratings  for  each  of  the  6-dimensions  of  the 
TLX  are  presented  in  the  main  body  of  Table  3  and 
the  overall  rating  is  presented  under  the  heading 
“Mean.”  As  shown  in  Table  3,  the  average,  overall 
rating  was  higher  for  the  mixed  (49-83)  compared  to 
the  immediate  condition  (45.25).  Likewise,  their 
ratings  on  each  dimension  of  the  TLX  under  the 
mixed  condition  were  higher  than  under  the  immedi¬ 
ate  condition.  However,  non  of  these  differences 
were  statistically  significant. 

The  Relationship  Between  the  Temporal  Characteristics 
of  the  Simulation  Environment,  Objective  Workload  and 
Communication  Performance 

All  of  the  participants  communicated  with  14 
data-link-equipped  and  10  non-data-link-equipped 
aircraft.  Incomplete  data  led  to  the  exclusion  of  8 
aircraft,  of  which  3  were  data  link  equipped.  Most  of 
these  aircraft  were  in  a  handoff  mode  or  on  final 
approach  at  the  very  beginning  or  end  of  the  simula¬ 
tion  and  they  served  the  purpose  of  filling  time  as  the 
aircraft  of  interest  entered  and  departed  the  scenario. 


This  left  1,579  of  the  original  1,952  controller¬ 
generated  transmissions  in  the  database.  Two  sepa¬ 
rate  sets  of  analyses  were  performed  on  each  of  the 
dependent  measures. 

For  the  first  set,  the  data  were  arranged  according 
to  the  type  of  aircraft  equipage  and  ghost  pilot- 
response  type,  while  ignoring  the  mode  of  communi¬ 
cations  classification  used  for  information  transfer. 
This  allowed  for  a  comparison  between  ATC  opera¬ 
tional  communications  for  aircraft  with  and  without 
a  data  link  capability.  During  one  simulation,  all  of 
the  aircraft  responded  immediately  to  all  transmis¬ 
sions  (immediate  condition) .  During  the  other  simu¬ 
lation,  controllers  received  immediate  oral  responses 
from  all  of  the  aircraft  to  their  voice  radio  communi¬ 
cations.  Acknowledgments  to  their  data  link  trans¬ 
missions  from  data-link-equipped  aircraft  were 
delayed  by  about  11s  (mixed  condition). 

For  the  second  set  of  analyses,  the  data  were 
rearranged  according  to  the  mode  of  communica¬ 
tions  used  by  the  controllers  for  message  transfer  and 
ghost  pilot-response  type,  while  ignoring  the  type  of 
aircraft  equipage.  This  allowed  for  a  comparison 
between  mode  of  communications,  independent  of 
aircraft  equipage.  During  each  simulation,  the  tem¬ 
poral  characteristics  were  always  immediate  for  voice 
radio  transmissions  (immediate)  and  either  immedi¬ 
ate  or  delayed  for  data  link  (mixed). 

Type  of  Aircraft  Equipage  and  Ghost  Pilot  Response 
Type  (Collapsing  on  Mode  of  Communications) 

Controller  Workload.  The  results  indicated  that  con¬ 
troller  workload  was  affected  by  the  communications 
capability  onboard  the  aircraft  but  not  ghost  pilot 
response  type.  As  shown  in  Table  4,  transmissions  made 


TABLE  3.  Mean  NASA  TLX  Ratings  Presented  by  the  Temporal  Characteristics  of  the 
Simulation 


NASA  TLX  Dimensions 

Source 

Mental 

Physical 

Temporal 

Performance* 

Effort 

Frustration 

Mean 

Temporal  Characteristics 

Immediate 

45.75 

45.62 

45.75 

42.12 

43.38 

48.88 

45.25 

(12.24) 

(14.48) 

(12.08) 

(11.42) 

(13.94) 

(17.84) 

(12.13) 

Mixed 

48.50 

50.12 

50.25 

51.62 

49.38 

49.12 

49.83 

(15.35) 

(13.66) 

(11.07) 

(12.11) 

19.40) 

(18.29) 

(13.85) 

*  A  lower  value  indicates  a  rating  of  improved  performance 
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TABLE  4.  Measures  of  Workload  and  Communication  Performance  Presented  by  Aircraft  Equipage 
and  Pilot  Response  Type  (Collapsed  over  Mode  of  Communications) 


Objective  Measures  of  Workload  and  Communication  Performance 


Num 

Aircraft 

Pause 

Duration 

Pause 

Freq 

Total 

Time 

Adj 

Time 

Num 

Restarts 

Num 

Topics 

NSC  per 
Message 

Num 

Syllables 

Aircraft  Equipage 

Data  Link 

6.22 

(1.01) 

.39* 

(.47) 

.09 

(-07) 

3.49* 

(.69) 

3.10* 

(-37) 

.04* 

(.03) 

2.35* 

(.14) 

.30* 

(.30) 

18.10 

(1.03) 

Non-Data  Link 

6.33 

(1.04) 

.03 

(-03) 

.05 

(.05) 

2.63 

(.27) 

2.60 

(.27) 

.02 

(.03) 

2.53 

(.12) 

.77 

(-23) 

19.02 

(19.32) 

Ghost  Pilot  Response  Type 

Immediate 

6.19 

(-72) 

.14 

(.20) 

.08 

(.06) 

2.98 

(.54) 

2.84 

(-40) 

.02 

(.02) 

2.46* 

(.18) 

.58 

(.38) 

18.76 

(1.38) 

Mixed 

6.36 

(1.26) 

.28 

(.49) 

.06 

(.06) 

3.14 

(.80) 

2.86 

(.43) 

.04 

(.04) 

2.42 

(.13) 

.49 

(.33) 

18.36 

(1.13) 

Aircraft  Equipage  by  Pilot  Response  Type 

Data  Link  -  Immediate 

6.15 

(.66) 

.24 

(.24) 

.08 

(-07) 

3.31 

(.55) 

3.07 

(-40) 

.03 

(-02) 

2.37 

(.16) 

.34 

(-32) 

18.36 

(1.15) 

Non-Data  Link  -  Immediate 

6.23 

(.83) 

.03 

(.03) 

.07 

(.05) 

2.64 

(.27) 

2.61 

(.26) 

.01 

(.03) 

2.56 

(-14) 

.82 

(.26) 

19.17 

(1.55) 

Data  Link  -  Mixed 

6.28 

(1-32) 

.54 

(.61) 

.09 

(.07) 

3.67 

(.80) 

3.13 

(.37) 

.05  9.04) 

2.33 

(.11) 

.26 

(.28) 

17.84 

(0.90) 

Non-Data  Link  -  Mixed 

6.44 

(1.28) 

.02 

(.03) 

.02 

(.03) 

2.62 

(.32) 

2.60 

(.30) 

.02 

(.03) 

2.50 

(-10) 

.72 

(.18) 

18.87 

(1.14) 

*Statistically  significant,  p  <  .05. 


to  data-link-equipped  aircraft  took  longer  to  complete 
(total  time)  than  transmissions  to  non-data-link- 
equipped  aircraft,  F(l,7)  =  60.06,  pc. 05.  Likewise, 
transmissions  made  to  data-link-equipped  aircraft  con¬ 
tained  longer  pauses  than  those  made  to  non-data-link- 
equipped  aircraft,  F(l,7)  =  9.64,  pc. 05.  The  difference 
observed  between  data  link  and  non-data-link-equipped 
aircraft  for  pause  frequency  was  not  significant,  F(l,7) 

=  2.31,  p>.05. 

Communication  Performance .  As  in  the  previous 
Prinzo  study  (1998),  even  when  hesitation  pauses  are 
removed  from  the  controllers’  transmissions,  they 
still  spent  more  time  on  frequency  communicating 
with  data-link-equipped  aircraft,  F(l,7)  =  29.17, 
pc. 05.  In  addition,  messages  transmitted  to  data- 
link-equipped  aircraft  were  more  accurate,  F(l,7)  = 
69-51,  pc. 05,  and  contained  fewer  aviation  topics, 
F(l,7)  =  20.27,  pc. 05.  Controllers  also  transmitted 


more  aviation  topics  when  ghost  pilot  responses  were 
immediate,  F(l,7)  =  9.19,  pc. 05.  Finally,  controllers 
also  restarted  transmissions  to  data-link-equipped 
aircraft  more  often  than  to  non-data-link-equipped 
aircraft,  F(l,7)  =  19.16,  pc. 05. 

Mode  of  Communications  and  Pilot  Response  Type 
(Collapsing  on  Aircraft  Equipage) 

Controller  Workload.  As  shown  in  Table  5,  the 
mode  of  communications  used  by  controllers  influ¬ 
enced  workload  but  ghost  pilot  response  type  did  not. 
That  is,  when  controllers  used  data  link,  their  trans¬ 
missions  took  nearly  2s  longer  to  complete  than 
messages  sent  by  voice  (mean  total  time  DL=  4.39s, 
V=  2.40s),  F(l,7)  =  35.93,  pc. 05.  Also,  data  link 
messages  contained  longer  pauses  (i.e.,  pause  dura¬ 
tion)  than  messages  initiated  by  voice  radio,  F(l,7) 

=7.89,  pc. 05. 
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TABLE  5.  Measures  of  Workload  and  Communication  Performance  Presented  by  Mode  of 
Communications  and  Ghost  Pilot  Response  Type  (Collapsed  over  Aircraft  Equipage) _ 


Source 

Measures  of  Workload  and  Communication  Performance 

Num 

Aircraft 

Pause 

Duration 

Pause 

Freq 

Total 

Time 

Adj 

Time 

Num 

Restarts 

Num 

Topics 

NSC  per 
Message 

Num 

Syllables 

Mode  of  Communications 

Data  Link 

6.23 

.63* 

.12 

4.39* 

3.77* 

* 

00 

o 

2.13* 

0.00* 

18.44 

(-98) 

(.79) 

(.id 

(1.01) 

(.46) 

(.06) 

(.01) 

(.00) 

(.94) 

Voice  Radio 

6.27 

.02 

.04  9.04) 

2.40 

2.38 

0.00 

2.60 

.74 

18.34 

(1.10) 

(.02) 

(.23) 

(.22) 

(.00) 

(.10) 

(.34) 

(1.13) 

Ghost  Pilot  Response  Type 

Immediate 

6.18 

.21 

.08 

3.30 

3.09 

.03 

2.38 

.39 

18.64* 

(.70) 

(.32) 

(.07) 

(1.07) 

(.82) 

(.040) 

(.28) 

(.48) 

(1.09) 

Mixed 

6.31 

.43 

.08 

3.49 

3.05 

.05 

2.36 

.34 

18.19 

(1.29) 

(.83) 

(.10) 

(1.43) 

(.79) 

(.07) 

(.26) 

(.42) 

(.94) 

Mode  of  Communications  by  Ghost  Pilot  Response  Type 

Data  Link  -  Immediate 

6.20 

.40 

.09 

4.16 

3.78 

.06 

2.13 

0.00 

18.70 

(.66) 

(.38) 

(.10) 

(.83) 

(.58) 

(.04) 

(.13) 

(.00) 

(1.08) 

Voice  Radio  -  Immediate 

6.16 

.03 

.06 

2.43 

2.40 

0.00 

2.62 

.78 

18.59 

(.78) 

(.02) 

(.05) 

(.19) 

(.18) 

(.00) 

(.09) 

(.37) 

(1.17) 

Data  Link  -  Mixed 

6.25 

.86 

.14 

4.62 

3.76 

.09 

2.13 

0.00 

18.17 

(1.27) 

(1.03) 

(-12) 

(1.17) 

(-35) 

(.07) 

(-11) 

(.00) 

(.76) 

Voice  Radio  -  Mixed 

6.38 

.01 

.02 

2.36 

2.35 

0.00 

2.59 

.69 

18.21 

(1.40) 

(.01) 

(.02) 

(.27) 

(-27) 

(.00) 

(.11) 

(-32) 

(1.14) 

^Statistically  significant,  p  <  .05. 


Communication  Performance.  As  expected,  con¬ 
trollers  spent  more  time  on  frequency  even  when 
pauses  were  removed  from  their  data  link  transmis¬ 
sions  (i.e.,  adjusted  for  pause  duration),  F(l,7)  = 
190.27,  p<.05.  Although  data  link,  rather  than  voice 
messages  were  restarted  more  often  F(l,7)  =  19.81, 
pc. 05,  the  data  link  messages  were  more  accurate, 
F(l,7)  =  37.13,  p<*05,  and  contained  fewer  aviation 
topics  than  those  transmitted  by  voice  radio,  F(l,7) 
=  181.45,  pc. 05.  This  finding  was  replicated  on 
1,430  of  the  original  1,954  transmissions  -  transmis¬ 
sions  devoid  of  common  salutations,  courtesies,  or 
both.  Transmissions  that  involved  initial  contact  also 
were  excluded  since  they  were  performed  using  voice 
radio.  Once  again,  more  topics  were  transmitted  by 
voice  radio  (Mean  =2.21  SD  =  .14)  than  data  link 
(Mean  =  2.16  SD  =  .11),  t(l ,7)  =  -3.01,  pc. 05.  When 
aircraft,  regardless  of  communications  equipage. 


responded  immediately,  controllers’  transmissions 
were  notably  longer  (number  of  syllables),  F(l,7)  = 
5.93,  pc. 05,  although  not  more  informative  (number 
of  topics)  or  requiring  longer  to  transmit. 


The  Relationship  Between  the  Temporal  Characteris¬ 
tics  of  Downlinked  Ghost  Pilot  Response  Type  and 
Initial  Contact  and  Transfer  of  Control  Performance 
Based  on  the  previously  reported  studies,  it  was 
anticipated  that  the  amount  of  time  controllers  allot¬ 
ted  for  initial  contact  and  transfer  of  control  services 
was  a  function  of  the  temporal  aspects  of  communi¬ 
cations  system.  Therefore,  directional,  paired  t-tests 
were  performed  for  only  data-link-equipped  aircraft 
that  completed  initial  call-up,  initiate  transfer  radar 
track,  and  transfer  of  communication  subtasks.  There 
were  206  controller  transmissions  made  to  data-link- 
eligible  aircraft  (70  voice-radio  and  136  data  link).  The 
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TABLE  6.  Ghost  Pilot  Response  Type,  Air  Traffic  Service,  and  Mode  of  Communications 
Presented  by  Distance  from  the  Airport  and  Time  to  Complete  Each  Subtask _ 

Distance  and  Time  to  Complete  ATC  Subtasks 
Distance  (in  miles)  Time  (in  seconds) 

Source  Radar  Communications  Radar  Communications 


Initial  Contact  Services 
Ghost  Pilot  Response  Type 


Immediate 

64.26  (1.23) 

62.60(1.01) 

3.16(0.45) 

1.82  (0.31) 

Delayed 

64.46  (1.32) 

62.73  (1.35) 

3.98  (1.43) 

1.82  (0.33) 

Transfer  of  Control  Services 

Ghost  Pilot  Response  Type 

Immediate  43.63  (12.70) 

33.50  (2.37) 

2.72  (0.54) 

2.64  (0.39)* 

Delayed 

44.15  (  9.64) 

33.42  (1.74) 

2.59  (.30) 

3.85  (1.14) 

Mode  of  Communications 

DataLink  40.41  (11.87) 

33.91  (2.60) 

3.09  (0.72) 

3.29  (0.38) 

Voice  Radio 

42.91  (  9.17) 

34.32  (1.84) 

2.68  (0.43) 

2.65  (0.19) 

*Statistically  significant,  p  <  .05. 


mean  and  SD  time  (to  perform  each  subtask  and  the 
aircraft’s  distance  along  its  arrival  route  to  the  airport 
are  presented  in  Table  6. 

As  predicted  for  the  Initial  Contact  Services,  there 
were  no  differences  in  where  an  aircraft  was  as  it 
approached  the  sector  or  how  long  controllers  took  to 
accept  radar  contact  or  establish  communications 
since  the  procedure  associated  with  each  subtask  was 
retained.  In  addition  for  the  Transfer  of  Control 
Service,  it  is  not  surprising  that  no  difference  was 
observed  for  the  transfer  of  radar  track  subtask  since 
the  receiving  controller  accepted  the  radar  track  as 
soon  as  it  appeared  flashing  on  his  radar  display. 
There  was,  however,  a  significant  difference  resulting 
from  the  temporal  characteristic  of  the  downlinked 
response  -  when  responses  were  delayed,  controllers 
took  an  additional  1.2s  to  complete  the  transfer  of 
communications  subtask,  t(7)  =  -2 .44,  p  <  .05.  A 
final  analysis  revealed  that  the  mode  of  communica¬ 
tions  that  controllers  selected  did  not  influence  the 
distance  or  time  measures  of  transfer  of  radar  track 
and  communications  subtask  performance. 

As  mentioned  previously,  controllers  could  com¬ 
plete  the  transfer  of  control  services  transfer  of  com¬ 
munications  subtask  by  voice  radio  or  data  link  using 


the  manual  mode  TOC.  When  the  analyses  per¬ 
formed  on  the  temporal  characteristics  of  the  ghost 
pilot  responses  and  mode  of  communications  are 
taken  together,  the  data  revealed  that  temporal  de¬ 
mands  —  not  mode  of  communications  —  signifi¬ 
cantly  influenced  controller  performance  of  the 
transfer  of  communications  subtask. 

DISCUSSION 

Operational  communication  tasks,  whether  per¬ 
formed  by  pilots  or  by  air  traffic  controllers,  take  time 
to  complete.  As  data  link  becomes  fully  integrated 
into  the  air  traffic  control  system  and  CPDLC  is 
transitioned  into  the  operational  environment,  con¬ 
trollers  will  have  the  flexibility  to  determine  which  air 
traffic  services  are  provided  by  voice  radio  and  by 
data  link.  It  stands  to  reason  that  the  workload 
experienced  by  controllers  will  change  as  communi¬ 
cation  become  less  verbally-  (listen,  speak)  and  more 
visually-  (eye,  hand)  driven.  Along  the  same  lines,  it 
would  seem  that  changes  in  the  temporal  aspects  of 
the  communications  system  would  influence  the  per¬ 
formance  of  operational  communication  tasks  by 
controllers. 
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In  this  simulation  study,  the  temporal  aspects  of 
the  communications  environment  was  manipulated 
by  having  controllers  experience  either  no  pilot  down¬ 
link  delay  or  a  delay  of  approximately  11s.  Pilot 
delays  did  not  seem  to  unfavorably  influence  control¬ 
lers’  perceptions  of  workload,  although  they  gener¬ 
ally  felt  that  their  performance  was  somewhat  affected. 
Unlike  the  Prinzo  study  (1998)  that  reported  a  sig¬ 
nificant  increase  in  the  frequency  of  pauses  in  the 
mixed  modality  environment,  it  was  not  a  significant 
factor  in  this  study  because  all  communications  oc¬ 
curred  in  a  mixed  environment.  Interestingly,  the 
same  trend  appeared  for  more  frequent  pauses 
when  communications  involved  aircraft  equipped 
with  voice  radio  +  data  link  than  aircraft  equipped 
for  voice  radio. 

The  only  evidence  of  changes  in  workload  came 
from  the  objective  measures  of  total  time  on  fre¬ 
quency  and  duration  of  pauses.  Specifically,  trans¬ 
missions  to  data-link-equipped  aircraft  took  .86s 
longer  to  complete  than  those  to  non-data-link- 
equipped  aircraft  (DL  aircraft  =  3.49s,  NDL  aircraft 
=  2.63s).  The  longer  transmission  times  to  data-link- 
equipped  aircraft  were  the  result  of  the  mode  of 
communications  selected  by  the  controller.  In  par¬ 
ticular,  when  controllers  sent  messages  over  a  data 
link,  they  took  nearly  2s  longer  to  complete  those 
transmissions  than  messages  sent  by  voice  radio  (DL 
message  =  4.39s,  V  message  =  2.40s). 

Why  did  controllers’  data  link  transmissions  take 
longer?  Part  of  the  reason  may  lie  in  the  observation 
that,  of  the  114  transmissions  containing  pauses, 
over  60%  involved  data  link  (DL  =  73,  V  =  41).  The 
longer  pauses  in  these  data  link  messages  suggest  that 
controllers  had  more  time  available  for  strategic  pro¬ 
cesses  and  planning  activities  (Ericsson  &  Simon, 
1980).  Prinzo  et  al.  (1998)  suggest  that  the  longer 
pauses  made  by  controllers  in  an  earlier  simulation 
study  could  reflect  cognitive  activity  associated  with 
strategizing  during  message  construction.  Just  as 
light  traffic,  coupled  with  expertise,  may  have  af¬ 
forded  controllers  in  the  earlier  study  more  time  to 
think,  providing  controllers  in  this  study  with  a 
multi-modal  communications  system  may  have  alle¬ 
viated  the  communications  bottleneck  imposed  by 
one-user-at-a-time  communications. 


An  examination  of  the  controller  data  link  mes¬ 
sages  revealed  transmissions  with  pauses  greater  than 
20s  involved  either  a  transfer  of  communications 
(60%)  or  an  instruction  to  descend  to  a  lower  altitude 
(40%).  Generally,  controllers  constructed  these  mes¬ 
sages  while  an  aircraft  was  approaching  a  sector 
boundary  or  transition  point.  While  waiting,  they 
had  the  opportunity  to  send  a  voice  message  to 
another  non-data-link-equipped  aircraft.  In  fact,  at 
the  controllers  discretion,  over  1 00  pairs  of  transmis¬ 
sions  (i.e.,  1 1%  of  the  transmissions)  involved  paral¬ 
lel  performance  of  operational  communications  tasks. 
It  was  discovered  that,  if  the  first  message  gave 
advance  runway  information  (3 1  %)  or  an  instruction 
(37%),  the  controller  was  simultaneously  establish¬ 
ing  radar  contact  (44%)  or  transferring  communica¬ 
tions  (25%)  with  another  aircraft.  Temporal  factors 
did  not  seem  to  be  a  factor  in  the  development  of  this 
efficiency  strategy.  It  appears,  then,  that  the  longer 
pauses  may  have  resulted  from  controllers  selecting/ 
constructing  messages  best  suited  for  the  current 
operational  task,  thereby  providing  communications 
in  parallel,  or  both.  Using  a  multi-modal,  simulta¬ 
neous  communications  system  provided  these  con¬ 
trollers  with  the  capability  for  off-loading  routine, 
non-time  critical,  operational  tasks  to  data  link,  while 
simultaneously  performing  verbal  communication  tasks. 

Communication  performance  also  was  influenced 
by  mode  of  communications.  Controllers  had  the 
option  of  sending  single  or  multiple  topic  messages 
either  by  voice  (e.g.,  descend  to  and  maintain  five 
thousand,  turn  right  heading  two  eight  zero,  descend 
and  maintain  six  thousand)  or  data  link  (e.g.,  A050, 
H280  A060).  When  messages  were  transmitted  to 
aircraft  that  were  not  data  link  equipped,  they  often 
contained  common  salutations  and  courtesies  typical 
of  social  situations.  Although  such  commonplace, 
non-standard  communications  are  not  part  of  the 
required  phraseology  contained  in  FAA  Order  7110 . 65 
nor  are  they  included  in  the  CPDLC  message  set3. 
The  presence  of  these  non-standard  communications 
also  added  to  the  length  of  voice  radio  transmissions. 
Another  analysis  was  performed  on  a  restricted  set  of 
messages  devoid  of  common  salutations,  courtesies, 
or  involved  in  initial  contact  services.  The  results  of 
that  analysis  replicated  the  original  finding  and 


3  See  US  DOT  FAA  Specifications  for  Controller-Pilot  Data  Link  Communications  Build  1A ,  Appendix  A. 
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supported  the  conclusion  that  mode  of  communica¬ 
tions  affected  message  length,  but  the  temporal  as¬ 
pects  of  the  mode  of  communications  did  not. 

The  absence  of  these  non-standard  communica¬ 
tions  in  data  link  messages  also  helps  to  explain  why 
messages  that  were  sent  to  aircraft  equipped  with  data 
link  were  more  precise  and  shorter.  First,  data  link 
topics  were  preformatted,  thus  making  them  less 
error-prone.  Second,  the  data  link  message  set  does 
not  include  any  pleasantries  or  salutations.  Third, 
more  of  the  messages  that  were  transmitted  to  data- 
link-equipped  aircraft  were  sent  by  data  link  than  by 
voice  radio.  Finally,  controllers  were  not  provided  with 
an  option  or  opportunity  to  construct  or  append  "free- 
text"  as  part  of  their  uplink  messages.  Communication 
performance  also  was  influenced  by  the  temporal 
aspects  of  the  communications  environment.  When 
working  dynamic  air  traffic,  where  all  the  aircraft 
responded  immediately,  regardless  of  equipage,  con¬ 
trollers’  messages  were  notably  longer  (number  of 
syllables)  but  not  necessarily  more  informative  (num¬ 
ber  of  topics)  nor  did  they  take  longer  to  transmit. 
When  aircraft  response  time  varied,  as  they  did  in  the 
mixed  condition,  (immediate,  delayed  by  11s)  con¬ 
trollers  took  an  additional  1 .2s  to  complete  the  trans¬ 
fer  of  communications  subtask.  And  it  is  not  surprising 
that  neither  aircraft  distance  from  the  airport  nor  the 
amount  of  time  taken  to  complete  the  transfer  of 
radar  subtask  were  affected  by  the  11s  delay.  Since  the 
delays  associated  with  data  link  were  independent  of 
radar  subtasks,  controllers  were  not  compelled  to 
develop  compensatory  strategies  because  none  were 
needed.  It  is  also  possible  that  delay  had  no  effect 
because  the  receiving  controller  accepted  the  radar 
handoff  as  soon  as  the  data  tag  began  flashing.  Future 
studies  may  be  needed  to  explore  the  automatic  mode 
for  the  transfer  of  communications  subtask.  When 
operating  in  the  automatic  mode,  the  CPDLC  system 
will  send  the  TOC  uplink  message  after  hand-off 
acceptance  of  the  track4. 

In  summary,  the  primary  finding  of  this  study  was 
that  controllers  took  longer  to  formulate  and  trans¬ 
mit  messages  over  a  data  link-communications  sys¬ 
tem,  but  their  messages  were  more  accurate  and 
contained  fewer  message  elements.  It  would  seem 


that  controller  access  to  and  the  availability  of  differ¬ 
ent  modes  of  communication  clearly  improved  the 
efficiency  of  ATC/pilot  communications.  Prior  to 
data  link,  operational  tasks  were  performed  succes¬ 
sively.  When  data  link  communications  becomes 
part  of  the  air  traffic  control  environment  controllers 
will  have  the  option  of  performing  tasks  sequentially 
or  in  parallel  using  either  voice  radio  or  CPDLC.  As 
indicated  by  the  communications  data,  the  longer 
latencies  associated  with  data  link  messages  often 
resulted  from  deliberate  actions  on  the  part  of  the 
controllers.  The  longer  latencies  did  not  result  in  a 
loss  of  efficiency  but  reflected  innovations  on  the  part 
of  the  controllers  to  optimize  their  performance.  By 
placing  data  link  messages  in  a  pending  status  con¬ 
trollers  could  participate  in  concurrent  communica¬ 
tions  with  other  non-data-link-equipped  aircraft.  This 
benefit  provided  controllers  with  added  flexibility  and 
clearly  enabled  them  to  decide  which  modality  was  best 
suited  for  each  operational  communications  task. 
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